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ABSTRACT 

Good and poor explanatory essays o£ 40 college 
freshmen were analyzed for 18 cohesive ties and chains to determine 
the appropriateness of the cohesion system for teaching and 
evaluating writing. The questions that were specifically addressed 
were, (1) How do writers use the cohesive resources of the language? 
and (2) How is cohesion related to teachers' perceptions of writing 
quality? The analysis revealed that the density of ties and length of 
chains increased disproportionately to the length of essays, A review 
of individual specimen essays suggested that greater variety and 
maturity of lexical choice characterized the good essays. Poor essays 
had frequent pseudochains — long strings of coinmon high-frequency 
words bearing very little semantic import. Most good and poor essays 
had a dominant chain connecting several paragraphs. The findings 
suggest that the cohesion system lacks content and domain selection 
validity to be appropriate as an evaluation scheme. The system could 
be used in instruction by a teacher at the point of responding and 
suggesting revisions, but not as the central emphasis of instruction. 
(HOD) 



********************************************* 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
************************************************************************ 



NATIONAL INSTfTUTE OF EDUCATION 

EDUCATIONAL RESOURCES INFORMATION 
•(> ^ ^ • CENTER lERiC) 

• : : Tha documtnt hai bt«n rtproductd ii 

receivtd from the person or orginizatton 

yoriflinAting it. 
Minor chanjjw have been made to improve 
reproduction quality. 



ITS 

-4" 

Csi 



UA OVARTMINT or nUCATMN 



Points of view or opiniont ttat*d in this docu - 
nrwnt do not necessarily represent oHicial NIE 
position or policy. 



COHESION IN TEACHING AND EVAI.UATION: 
PROBLEMS AND IMPLICATIONS 



Jerome L. Meaner 

Instructor, Academic Development 
Canislus College 
Buffalo, New York 14?08 
716-883-7000 ext. ?07, 208 



•PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 

Jerome L, Neuner 



^ERJC ^0 THE EDUCATIONAL RESOURCES 

^ INFORMATION CENTER (ERIC) " 




Abstract 

This research studied cohesive ties and chal,n8,ln the good and poor 
explanatory essays of 40 college freshmen and questioned the approprlatenean-x 
of the cohesion system for teaching and evaluating writing. Of 18 cohesion 
variables studied, only 1 showed significant difference hetx^/een the good and 
poor essays. In addition, the length of cohesive ties from coherer to 
precursor did not distinguish the good from poor writing, but the length o^ 
cohesive chains when corrected for length of essay was a strong discriminator 
of good and poor essays. A study of good and poor essays by length (long or 
short) indicated that the density of ties and length of chains Increased 
disproportionately to the length of esaays. A review of individual specimen 
essays suggested that greater variety and matiirlty of lexical choice 
characterized the good essays. Poor essays also have frequent pseudo chains, 
long strings of common high-frequency words bearing very little semantic 

I import. Most good and poor essays had a dominant chain connecting several 

I 

; paragraphs together. The methodology of the research included means' tests 
and ANOVA for statistical comparisons as well as the examination of cases. 
The phi coetflcient was ur.ed to measure the Interrater reliability of cohesion 
analysis. The findings of the complete stiudy strongly suggested t^at the 
cohesion system lacks content and domain selection validity to be appropriate 
as an evaluation scheme. The system could be used in instruction by a teacher 
at the point of responding and suggesting revisions, but not as the central 
emphasis of instruction. The terminology of the cohesion system is valnable 
in that it supplements the terminology of traditional and transformational 
grammars . 
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Cohesion in Teachlnjg and Evaluation: 
Problems and Implications 



The publication of Halllday and Hasan's Cohesion in English (1976) has 
engendered a large body of research hy English educators, much of which 
appears to have as its goal estimating the usefulness of the cohesion system 
in evaluating and teaching composition. The research reported here will 
suggest that researchers have jumped too quickly from theory and description 
of cohesion to applying it as an emphasis In instruction or a method of 
evaluation. In other words, cohesion research stands In danger of repeating 
the sequence of events that occurred with transformational sentence 
combining! from theoretical background (Hunt, 1965; Mellon, 1969) to 
application in teaching and evaluation (O'Hare, 1973) to a virtual cottage 
intiustry of sentence combining books that professed to work wizardry (Strong, 
1976) on a student's composing ability. Throughout this history some more 
skeptical voices were heard (Marzano, 1976 ; Shaughnessy, 1976) but on the 
whole the movement to use sentence combining In teaching could genuinely have 
been called a bandwagon; and the variables associated with syntatic density 
(mean t-unlt length, mean length of. clause) became aspects of many evaluation 
programs at schools and colleges. It took a body of more precise and careful 
research (Nold and Freedman, 1977; Gebhard, 1978; Stewart and Gro^e, 197P) to 
demonstrate that teacher's evaluations of student writing were not so closely 
tied to syntatic raatiirlty and that, hy Implication, a peHagogy emphasizing 
sentence combining could not deliver all the comprehensive outcomes first 
promised for It. 
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Thus there Is an urgency to do precise and basic research in the cohesion 
system before It becomes a part of the received but untested wisdom of 
teaching and evaluation. Already some early reviewers of Halllday and Hasan* s 
system (Holloway, 1981; Wltte and Falgley, 1981) have given cautiously 
favorable estimates. And more recent textbooks (Williams, 1981) have begun to 
use the terminology of cohesion In their discussions of transitions and 
sentence connection. A detailed analysis of cohesion has not yet been used In 
a large scale writing assessment, but reports from the 1980 National 
Assessment of Educational Progress Indicate that readers can be directed to 
use a simplified cohesion rubric in assessing compositions (Odell, 1981, 
122-123). It Is much too early to say that anotheir^bandwagon is forming, but 
it does not seem to be true that many teachers and researchers feel an 
attraction to cohesion and its apparent power to describe textual 
relationships. English teachers and researchers seem to practice frequently a 
kind of iron law of novelty: if some new insight from linguistics or 
psychology appears on the horizon, use it in teaching and evaluation until 
more exhaustive research questions its usefulney^s. Should not che opposite 
occur? Meticulous and careful questioning should precede the widespread 
application of linguistic theory or systems to teaching or evaluating 
v/riting. Researchers must not adopt a new terminology for teaching or new 
variables for research until they have evidence that the terminology is not 
simply a new jargon and that the variables genuinely distinguish good from 
poor writings 

How do writers use the cohesive resources of the language, and how is 
cohesion related to their teachers' perceptions of writing quality? These two 
questions are the focus of this research. Their answers have broad 
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inpllcatlons for both pedagogy and evaluation. The review of research 
described below empra'^lzes those studies directed either explicitly or 
Implicitly to evaluation or teaching. The cohesion system Itself ls> of 
course I fully described by Halllday and Hasan. All summaries are Inevitably 
reductive and Imperfect, but all researchers to date have simplified the 
system for their research uses. 
Review of Research 

Eller (1979) took an exhaustive look at the writing of 15 ninth-Rrade 
honor students and discovered that various kinds of lexical cohesion seemed to 
be the best indicator of the students' response to literature and that 
^reference cohesion was the primary evidence of ability to sustain a 
I self-sufficient ("endophoric," in the terminology of Halliday and Hasan) text 
without appeal to the non-textual ("exophorlc") environment . Hartnett (1^80) 
tried to teach the cohesion system to basic writers at a Texas college and 
then used counts of different kinds of ties as a criteria for evaluation of 
the essays. She had mixed results, with no significant differences found for 
teacher, treatment, or mode of writing for the experimentals over the 
controls. The teacher x treatment interaction r^as significant, but in general 
the correlation of holistic score with number of types of cohesive ties was 
quite small, only .2076 for all essays. 

Cherry and Cooper (1980) studied average and superior writers at grades 
four, eight, twelve, and college. They Introduced some Interesting varla>^les 
such as the average distance cf ties (by number of Intervening t-unlts between 
coherer and precursor) and the relative dispersion of ties 1n the first, 
second, and third thirds of essays. Their basic conclusion was that as 
writers mature they seemed to rely more on lexis and less on reference and 
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conjunctlon. (Substitution and ellipsis were rare.) The proportion of ties 
that were lexical wer.t up from 56% to 59% to 63% to 68% as students ascended 
across the four grades studied. Frltchard (1980) studied the good and poor 
compositions of 44 eleventh graders and discovered that the average use or 
frequency of total lexical or grammatical ties did not distinguish the good 
from the poor essays. On the other hand, she found that the notion of 
^'cohesive problem" does have some empirical validity since passages marked by 
her readers as "problem sections" varied from other sections by their 
proportional use of ties. Frltchard concluded that counts of cohesive .ties 
are not measures of their effectiveness and her conclusions are especially 
convincing. She used statistical transformations to stabilize the 
distributions and then repeated her tests using three different sets of 
variables: (1) average number of ties per 100 words, (2) frequency of ties per 
100 words, and (3) frequency of ties per t-unlt. No single type of tie was 
found to be a significant discriminator of good and poor essays In all thr : 
schemes, and the ANOVA test for all types of ties was also nonsignificant In 
each case. 

Wltte and Falgley (1981) studied five good and five poor Freshraan ef^says 
by using a simplified list of ties with frequency counts (ties per 100 
t-units) and relative percentages as their variables. Their findings were 
similar to those for Cherry and Cooper's twelfth graders: about .tworrthlrdg . 
of ties were lexical, and good essays seemed to have greater density of all 
types of ties, (No statistical tests were performed to compare good and poor 
writing.) They concluded that cohesion appeared to be an important propertv 
of writing, but no evidence suggested that large or f?mall numbers of ties In 
themselves effect writing quality. 
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Most recently Tlerney and Mosenthal (1983) studied 2A essays ranked by 
teachers for general coherence and divided Into two different topics (a 
biographical sketch and a thematic essay) under conditions of the writers' 
familiarity or unf amlllarlty with the subject (determined by whether the 
writers had seen a fllmstrlp). They found that cohesion varied by topic, 
with biographical sketches having a somewhat larger proportion of reference 
ties and thematic essays a larger proportion of lexical ties. But cohesive 
patterning did ijot predict rankings on general coherence. There was a 
familiarity x text topic interaction when looking at coherence rankings but 
not when looking at cohesive proportions. The main point was that 
familiarity, topic, and coherence did not seem related to the specifically 
lingulsitic aspect of texts detailing the use of lexical and reference ties. 
Cohesion was pervasive in all texts but causally unrelated to coherence. 
Tierney and Mosenthal used some interesting new varlbles such as the ratios 
of pronouns and lexical ties to total ties (P+L/T) and temporal conjunctives 
tov^otal conjunctive ties (TC/T). 

Several generalizations arise from this body of research. The research 
varies from highly exacting to more casual in quality, and the studies using 
the more precise techniques (inferential statistics, reliability 
coefficients, greater number of cases, data transformations) are more 
cautious in rftcomraending cohesion as a teaching or testing method. Another 
theme that appears is the search for cohesion variables that appear to 
distinguish good from poor writing, the writing o'f y?51jnger from that of olde 
students, and the different nodes or purposes of writing. These matters are 
not yet fully resolved. The research reported here will suggest some ^urthe 
considerations in the choice of variables and reliability coefficients and 
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offer some more explicit, remarks on the usefulness of cohesion. 

s 

Method 

The present research was an effort to replicate with greater precision a 
comparison of cohesive devices In good and poor freshman essays written on a 
single explanatory topic (I.e., research similar to that of Prltchard, Cherrv 
and Cooper, and Wltte and Faigley) but to expand and improve upon it hy 
examining new variables: the interrater reliability of cohesion analysis, a 
more complete ll'st of types of ties, the relative distances between coherers 
and precursors, the* mean length of cohesive chains, the dispersion of ties 
within texts, and the effects of length of essay. In addition, since nearly 
all researchers had argued for the need to examine cohesion non-statistically 
in Individual essays, an analysis of specimen essays was also performed. The 
logic of this comparison was quite simple. If the cohesion system Is to be 
useful as an evaluation method, it ought to show great variation across 
levels of writing quality. Choosing the very best and very poorest essays in 
a large representative sample provides the greatest extremes of quality. 

Essays were collected from a sample of over 600 written by college 
freshmen at a -summer orientation and testing session. The conditions were 
carefully controlled: each student received the topic assignment during 
check-in and had two hours of relatively unorganized time Including a lunch 
to think about or discuss the assignment with peers. All essays were written 
in fifty-minute sessions during the afternoon in proctored classrooms. The 
students themselves represented a wide range of abilities and aptitudes. 
Their SAT scores (combined verbal and math) ranged from 650 to lAOO and their 
high school averages ranged from 72. U to 98.2. The entire sample of essays 
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was read by a panel of twelve college professors who have had two to five 
years of experience with holistic scoring and who have demonstrated 
interrater reliability exceeding .90 In their use of a 1 (low) to A (high) 
holistic scale. The 20 good essays were selected randomly from among those 
that had received the highest holistic score (4) from two holistic readers 
and the 20 poor essays from those that had received the lowest score fT") from 
two readers. 

The cohesion analysis was then performed hy the researcher and two other 

English teachers after careful instruction and practice on essays from the 

original orientation sample. One of the teachers had participated in a 

previous cohesion study and was expe::t In using the system. The second had 

no experience and required approximately eight hours of instruction and 

practice before he could recognize satisfactorily the types of ties 

t 

considered in this research. The analysts worked with carefully written 
directions and had extensive practice in recognizing the types of ties 
studied in this research. A strict interpretation of cohesive relations was 
respected at all times: (a) each coherer had to have an identifiable and 
literal precursor in a prior t-ur.lt; (b) the list of common coherers was 
extt.-nsive; (c) erroneous or arabiguous references were not counted; and (d) 
cases of multiple cohesion were counted as distinct inHlvidual ties. For a 
complete description of these directions as well as examples of the coding 
and analysis protocols, see Neuner 1^83, 13A-139. 

Result s 

Reliability 

In this study the phi coefficient C^) (Kurtz and Mayo, 1979, 3Afi"-3S5> was 
used to measure the Interrater reliability two-by-two for the three cohesion 
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analysts. Phi Is used when the raw data are dlchotonous choices (yes or no, 
male or female) and was computed for this research by going through the 
readers* coding; sheets for several sample essays and tallying word-by-word 
their agreement or disagreement on the cohesive status of every word In the 
text. This word-by-word analysis of reliability Is much more rigorous than 
various rank order coefficients such as Kendall* s used by Pritchard In her 

c 

study, which used the ranking of most to least frequent types of cohesive 
ties In an essay. The three phi . coefficients for the analysts In this study 

were .839 (readers 1 and 2), .88) (readers 1 and 3), and .828 (readers 7. and 

1 

3). These coefficients are much higher than are usually found for most types 
of essay scoring procedures and approach the ^90 reliability usually required 
of standardized achievement tests. Many researchers have neglected the 
interrater reliability of cohesion analysis even though most recognize the 
number of "judgment calls" frequently required in using the system. The 
figures reported here suggest that the system can be used reliably If careful 
instructlon and practice are provided. Readers who wp.re not already 
experienced English teachers and essay graders would undoubtedly require many 
more hours of study and practice. 
F^ roportions of Cohesive Ties 

Table 1 Illustrates the raw numbers and percentages of the various types 
of cohesive ties as well as the results of 18 separate t-tests to compare the 
neans of each type of tie across the good and poor essays. The table 
provides the totals and percentages, but the statistical tests were performed 
on data transformed by a square root function recommended by Pritchard who 
cites Snedecor and Cochran (1957, 325-329). This analysis reconfirms the 
findings of many researchers to date: a simple counting of ties does not 
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appear to distinguish good from poor writing at this level. The various 

. ' - - . 

percentages of ties do not vary radld'ally f rom^ good to poor essays. 

* - - — ., - ^ 

•Comparative reference (line 4 Table 1) Is the only, type of cohesive tie that 
shows a significant difference between good' and poor. Several other ana1vse«\ 
were performed to verify this Important conclusion, Including a comparison of 

the average words per tie In each essay and a comparison of the averflge 

/ 

1 Table 1 

Cohesive Ties In Good and Poor Essays 



\ 

* type of 
, cohesive tie ' 


Good Essays 
N = 20 


Poor Essays 
N = 20 




probability 
value 




c 




it 


t 


1. 


pronouns 




Q a 




TOO 


.89 


.379 


2. 


demonstratives 


" 77 


5 5 

J • 7 


J J 




1.19 




3. 


definite articles 




3.1 


13 


1.9 


.69 


.495 


H. 


corparatlves 


20 


1.5 


3 


.0 


2.55 


.015» 


5. 


total reference 


268 


20.5 




20.4 


.48 


.637 


6. 


substitution/ellipsis 


26 


2.0 


e 


1.2 


.94 


.353 


7. 


additive conjunctions 






22 


3.2 


.57 


.571 


8. 


adversative 
conjunctions 


\° 


3.8 


29 ' 


U.2 


.34 


.735 


• 

9. 


caudal conjunctions 


11 


.1 


8 


1.2 


.37 


.712 


IC. 


\en:oral conjunction 


36 


2.7 


13 


1.9 


.98 




11. 


contlniiatlves 


1 


.0 


5 


.9 


.88 


.385\ 


12. 


total conj 'OTIC t ion 


\k2 


10. 1 


78 


11. '4 


.72 




13- 


sane item 


bhh 


'41.7 


293 


42.7 


.24 


.814 


Ik, 


synor\yTT)/hyponym 


91 


6.9 


58 


8.5 


.17 


.866 


15. 


superordinate 


32 




19 


2.8 


1.47 


.151 


16. 


general item 


12 




6 


.9 


.27 


.792 


17. 


collocation 


193 


i'J.7 




12.2 


1.44 


.157 


18. 


total lexical 


874 


"667? " 


|j60 


67.1 


1.02 


.313 


Totals 


1310 1 


100. 0 


686 


100.0 







degiT'es of freedor'. * 38 for all comparlijons 
• p <.05 

Total words: eood essays 78II poor eaoays 4265 
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number of lexical ties using data transformed by an arc sine function 
(Snedecor and Cochran, 1967, 325-323). These comparisons also failed to show 
statistically significant differences between the two groups of essays: 
^(38) ■ 1.37, and ^(38) ■ .18; £ nonsignificant in each case. 
Relative Cohesive Distances 

Halllday and Hasan (1976, 330-331) have a scheme for describing the form 
of cohesive ties relative to the number of intervening sentences betwaen 
coherer and precursor. The scheme Includes simple immediate ties, mediate 
ties, remote ties, and medlated-remote ties. In this research it was dfecided 
to dispense with the system in favor of a simpler counting of the Intervening 
t-unlts between precursors and coherers even If the Immediate precursor was 
not the original source of primary meaning. A relationship longer than an-c^ 
individual precursor-coherer pair was defined as a cohesive chain: a series 
of references, collocations, reiterations, synonyms, or superordinates all 
semantlcally related to one another. For each essay the total distances for 
all ties were summed up and then divided by the total number of ties in that 
essay to provide the average length in t-unlts of the cohesive ties. Then 
that average length was divided by the number of t-units in the essay to 
provide an average relative distance from coherer to precursor. For example, 
one essay was 26 t-unlts long, had 57 cohesive ties, with a total distance of 
119 t-unlts between the various coherers and precursors. Its average 
relative distance was: 119 -r 57 -r 26 ■ .080. The same strategy was uaerl to 
determine the average relative length of cohesive chains. The total distance 
of the three or four longest chains was divided by the number of chains, 
which was then divided by the number of t-unlts in the essay. For exainple, 
one essay had a total distance of A8 t-unlts for A cohesive chains and vyas 7-3 
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t-unlts long. The average relative length of those chains was: A8 f 4 t 23 
■ .522. The purpose of using these relative figures was to correct for the 
different lengths of essays. Obviously an essay 30 t-unlts long Is likely to 
have longer chains and ties than an essay 15 t-unlts long. So a relative 
rather than an absolute average length must be computed In order to compare 
essays on this variable. 

Table 2 Illustrates a comparison of the relative average (!lstances of 
ties and chains In the good and poor essays and In all essays. It must be 
remembered that these are relative figures and not the true average lengths 
of ties and chains. This analysis suggests that good and poor essays are not 
distinguished by the distances of Individual ties If length of essay has heen 
accounted for. However, the distance of chains does discriminate good from 
poor essays even If length of essay Is accounted for. This is another way o^^ 
saying that good essays seem to be more Intensely about their subjects than 
poor essays are, regardless of which essay Is longer. A word that Halllday 



Table 2 

Relative Average Distances 
of Cohesive Ties and Chains 



Variable 


All 

essays 


Good 
essays 
N « 20 


Poor 
essays 
N » 20 




probability 
value 


Average relative 
distance, coherer 
to precursor 


.099 


.103 


.095 


.60 


.552 


Average relative 
length of chairs 


.586 


.6^7 


.^)25 


2.86 


.007 



degrees of freedom » 38 
p. < .01 
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and Hasan like to use about this relationship Is "texture.** This research 
seems to suggest that texture resides more In cohesive chains than In 
Individual precursor-coherer ties. 
Dispersion of Ties 

Cherry and Cooper (1980) had suggested that good essays would have their 
cohesive ties more evenly spaced throughout the writing while poorer essays 
would have their ties more cumulated toward the end. To test this hypothesis 
eich essay was divided into thirds by t-unit count and the number ot ties in 
each third was tallied. Table 3 reports the percentages of total ties In the 
first, second , and third thirds of both good and poor essays. 



Table 3 

Percentages of Cohesive Ties in First, Second, 
?j^d Third Thirds of Good and Poor Essa^vs 



Section of 
Essay 


Good 
Essays 
N = 20 


Poor 
Essays 
N - 20 


Difference ■ 


F 


PrcbablUcy 
Value 


First Third 


26.75 


21^.8% 


1.9* 




.yZb 


Geccnd Third 




16.0% 




1.^69 


.192 


Third Third 


hQ.6% 


39. 2X 




..}8 


.589 



Dc-r7^es of rre€?da7i: between .groups 1 

within groups 38 
total 39 
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Table 3 Implies clearly that both good and poor fessays are roughly cumulative 
In that the c6ncen*:ratlon of ties Increases regularly from the first to 
second to third thlrdn of essays. However, In each third the difference 
between good and poor >sssays does not approach statistical significance. 

A good argument can be made on theoretical grounds that nearly all types 
of texts in every niode are likely to be generally cumulative with respect to 
cohesive ties. As a text evolves, more and more words come Into existence, 
and this fact makes It more likely that later words will be the coherers for 
earlier precursors. In addition, as a text evolves, greater opportunities 
for multiple cohesive ties occur In the' later words. If for example a 
student wrote an essay about the different sports teams he or she had played 
on and wrote a concluding sentence such as "I certainly enjoyed all these 
sports," then the word sports would be a multiple coherer (a superordinate) 
for the names of all the individual sports mentioned earlier in the essay. 
The same principle seems to be true for nearly every text regardless of 
subject. The only discourse for which this would not be true would be 
nontexts such as lists and inventories. 
Length of Essay 

lio researcher to date has attempted to estimate the effects that length 
or brevity of text have on the proportions or distributions of cohesive ties 
or chains. Prltchard (1980) for example carefully chose texts of aTbout the 
same length, 250 to 300 words, to rule out length of text as a confounding 
variable. Texts may have characteristics of recursiveness, iteratlveness, 
and unevenness which make it an terror to assume that long and short texts are 
simply macro and micro versions of each other with respect to cohesion- To 
explore this matter more carefully, the 6 longest and 6 shortest essays from 
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both the good and poor groups were analyzed for proportions and dispersion c 
tl;:»8 and the distances of ties and chains. These data along with several 
measures of essay length are reported for the good and poor essays In Table 
A. It should be understood that these measures were not transformed by 
square root or arc sine functions nor adjusted for the relative length of 
essay. The purpose of these comparisons was precisely to look at 
untransformed data to observe the effects of essay length on the various 
kinds of ties and distances. 

Table ^ 

Cohesive Ties and Distances in Long and ^hort 
wcod Essays and Poor Essays 

Good Essays Poor Essays 



Variable 


Long 


Short 


Long 


Short 




(N = 5) 


(N - €) 


(N - 6) 


(N » 6) 


Average Length 










Words 


5?1.6 


293.7 


309.7 


105. J 


t-unlts 


39.2 


21.2 


2t».8 


6.5 


Woi\ls/t-units 


13.3 


13.8 


12.5 


16.1 


Average IJuricr ;.r ties 










per 100 v.otxi: 


18.1 


15. 


l6.il 


11.3 


per t-anll 




2.1 


2.C 


1.8 


Perco;iT,an:es of r. .-3 










Re f 'jrerice 




rj.yx 


2U.-^i 


23.955 


r.ubititutior!/r;il1.p;;i3 


3.3X 


i.Hi 


1.35 




ConJ'uriction 


9.7; 


9.6% 


13. 5J 


8.5S 


liexlcal 


66.75 


68.8* 


61. :J 


66.2% 


First TTilrd 


28. 5X 


23.9% 


31.9% 


16.9% 


record 'Ihiiri 


3'^.3S 


33.8* 


33.9% 


39. ^45 


'Ihird -Hiird 


37. It 




3^.2% 


U3.7^. 


I'ean Cohe;;lvc ri;.t.i.''.c^;.. 


( in t-uiiitj) 








CoLtrer to i"."o. .ur.or 


M.CC 




2.35 


.77 


!jt?ru:th of a I'll- r. 


27.75 


1?.50 


14.7^ 


3.25 



-15- 

Table 4 tends to suggest that th€ various percentages of types of ties do 
not differ dramatically from the long to the short essays In either good or 
poor categories. The percentages of reference » substitution/ellipsis, 
conjunction and lexis are strikingly similar In the good and poor essays atwd 
also similar to the findings for the entire group of 40 essays studied In 
this research. 

Regar^ng the dispersion of ties, some differences appear between the 

/ 

long and short essays, especially In the essays of poor quality* Hov^ever, an 

Important .artifact of the cohesion system tends to Imbalance these 

percentages?^ In the coding of cohesive ties the first t-unlt of a text has 

no cohesive ties because there Is no prior text In which precursors can be ^ 

found. (I have excluded from this research the extremely rare Instances of 

cataphoric cohesion, ties In which the precursor Item comes after rather than 

before the coherer.) This removal of the first t-unlt from those potentially 

r 

available to contain coherers has an inc^lnate effect on the shortest of 
essays. For example. If an essay is only 6 t-unlts long there are 2 t-unlts . 
in each third of the essay. But the first third really has only 1 t-unlt 
available for coherers since no coherer can exist in the very first t-unlt of 
the text. On the other hand, removing the first t-unlt from a much longer 
text has a proportionally smaller effect on the number of ties In the first 
third of that text. This removal of 1 t-unit from each essay accounts for 
almost all the variation apparent in the dispersion of ties in the first 
\ third of essays across long and short texts. If the first t-unlt Is exclufled 

from consideration, the long and short essays demonstrate the same general 
cumulatlveness discovered in the entire sample of good and poor essays (Table 
3). 
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The mean distance figures In Table 4 are more Interesting. In each 
category the mean distances from coherers to precursors are almost exactly 
proportional to the length In words of the essays In that category. In other 

words I as the lengths of essays vary, the average distance from precursor to 

\ 
\ 

coherer seems to vary In ithe same proportion. However, this even 
proportionality Is not true for the mean length of chains. The gooc^ long 
essays are 77.6% longer In words and 8A.9X longer In t-unlts than the good 
short essays (521.6 to 293.7 In words; 39.2 to 21.2 In t-unlts) hut the\ 
chains In good long essays are 122X longer than they are In good short \^ 
essays. The poor long and short essays reflect similar differences. Poor 
long essays are 193X longer in words and 282X longer In t-unlts than thp poor 
short essays (309.7 to 105.4 In words; 24.8 to 6.5 In t-unlts), but the 
chains In poor long essays are 353% longer than they are In poor short 
essays. In other words, as essays become longer, the length of their 
cohesive chains becomes longer at an even greater rate. 

The figures for density of ties per t-unit and per 100 words show a small 
effect for t-unlts and a larger effect for words. Ties per t-units vary from 
1.8 for the shortest poor essays to 2.4 In the longest good essays. But ties 
per 100 words appear to vary more substantially from shortest to longest 
essays: 11.3 for poor short essays (105.2 words); 15, A for good short essays 
(293.7); 16.4 for poor long essays (309.7 word,s);l and 18.1 for good long 
essays (521.6 words). A greater appreciation of these values can be attained 
by considering lexical ties, which are the most frequent type in every case: 
in long good essays, one of every 8.26 words is a lexical coherer; in long 
poor essays, one in every 9.98 words; in short good essays, one in every 9.A2 
words; in short good essays, only one in every 14.67 words. These figures 
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make a strong argument that lexical cohesion flourishes where many words are 
available to set up the reverberations of synonyms, hyponyms, collocattons, 
superordlnates and reiterations. Conversely , lexical cohesion languishes 
where many fewer words are available. 

In summary, this admittedly exploratory glance Into length of essay has 
suggested that texture does and does not differ according to length of text, 
f^learly the various percentages of types of ties and the dispersion of ties 
(taking Into account the removal of the first t-unlt as a source of ties) do 
not appear to change substantially as length varies. However, the density of 
cohesive ties per 100 words and the length of cohesive chains do appear to 
vary substantially as length changes. Both are Important differences in 
their own right and also important because, as every teacher knows, in any^ 
given classroom writing situation the better essays tend also to be longer 
essays. It may be the case that, for example, the differences between good 
and poor essays discovered by Wltte and Falgley (1981) were really only 
differences related to length of essay and that the same differences would 
have been discovered if all the essays were poor but some were much longer 
than others. Future research should attempt to take into account these 
effects of text lengths whenever investigating essays of widely varying 
length. 

No t^ or £ values were computed for Table A because the number of cases 
was very small, and so these findings must be considered a flr-$t glance 
rather than a definitive study of texture by length of text. Also to be 
resisted is the desire to universalize these results. Studies of other types 
of writing and discourse may reveal other effects. 
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Specimen Essays 

K random selection of 10 essays, 5 good and 5 poor^ was examined 
word-for-word and the Items In the major cohesive chains tabulated In columns 
across the t-unlts and paragraphs In rows. This technique^ an adaptation of 
a method suggested by Halllday and Hasan (1976 » 16) » Is Illustrated by the 
following good essay and Its tabulation In Table 5. The subscript numbers 
Indicate the t-unlt count and the Italicized words indicate items In the 
dominant chain. ' 

My rather short life has been plagued with unsolicited 
advice It Is one of life's Ironies that only unwanted 
advice Is given. 2 When one really needs another's opinion 
one is immediately told to think things out alone. ^ 

One flint-like nugget of advice that I once received was 
to continue my upward climb out of the darkness of Ignorance 
by going on in mathematic s.^ My following this advice was a 
mixed blessing indeed. ^ I learned that math could be fun, 
when I wandered upon the correct answers. ^ I also learned 
that where numbers are concerned there is no Iflght at the end 
of the tunnel,^ there is always more to learn. g Numbers 
and I regard each other warily. ^ In fact, I have great 
respect for the power they have over me; the power to 
frustrate and the power to make situations clearer. 

In my pursuit of higher ma thematlcs I discovered letters 
accompanying numbers , then letters standing alone. This 
interested me as letters are my forte. ^2 ^ realized the 
piece of advice I received could even prove helpful, (although 
I cannot recall ever encountering an x on the street). It 
has been said that a math is the language God wrote the 
universe with.^^^ This means math is a powerful, universal, 
skill. Although numbers seem foreign to my nature I have 
realized they are just another form of communlcatlon.-j^^ 
Through mathematics other worlds, and even our world, can be 
explored to a greater extent. 3^7 




h ve .een .rtUr.rUy chosen by ..n.^, poe^.^irr" 

fo™ your ovn SHisbsr .y.te..„ The saue. 1„ 

-ortc, .ell.^g but It does the frustrated 55th student'. 

heart good to understand this notnh m u 

point. 2^ Numbers are only as 
powerful as you make then. ' 



Table 5 

Dominant and Minor Chains In a Good Essay 



Para- 
graph 


t-unlt 
number 


Docnlnant Chain 


Minor Chain 1 


Minor Chain 2 


Minor Chain 3 
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- 


advice 






1 


2 

— 5 


- 


advice 


- 


- 




3 

r 




opinion? 


- 


- 






mathefnatlcs 


advice 


- 


darkness 




5 




advice 


- 






6 


math 


- 


- 




c 


7 


nunbers 


- 




light 




8 




• 


- 


learn? 




.9 


nurbers 










10 


they 






power 

power 

frustrate 

power 

clearer 




11 


mathematics 
nunbers 




letters 
letters 






12 






letters 


forte? 




13 




advice 


2n X 




3 


14 


math 


1 


iarguage 
ViTote? 






1$ 


math 






powerful 




16 ■ 


nunbers 
they 




(form of) 
ccrriinicatlon 






17 


mathematics 










18 


nutters 


advice 








19 


nuriber system 










20 


system 








^ 


21 


math 






frustrated 




22 


nunbers 
them 






powerful 



? signifies an Item that could be challenged for its place 
in the c^ialn. 
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A tabulation such as this provides at a glance a visualization of the 
length of chains (in t-units), the number of items in chains, the amount 
of iterativeness and variety in lexical Items, the degree to which chains 
are confined to or extended beyond paragraphs, and the places where chains 
intersect in individual t-units. The tabulation also suggests some of the 
decisions a researcher must make on whether certain words are lexically 
related and belong in the same chain. Some good examples are In Minor 
Chain 2: are power and light collocations? Is to frustrate a true 
opposite of to make , . . clearer ? Does forte belong in the chain? These 
questions might cause genuine arguments among different people, and no 
simple method to resolve them yet exists. 

For the purposes of comparisons, below is a poor essay and Table 8 i 
tabulates its chains. 

As a graduating senior I would like to pass on a word of 
advise to all of you.^ As I was entering my first year at 
our beloved school, a graduating senior of that year told me, 
"Always listen to your parents . ^ As you get into your 
latter teens you start to "break away" from your parents , 
because "your old enough to make your own decisions**^ and 
"your friends are allowed to."^ But they have already lived 
through everything you are going through, i- so you should 
listen to them .^ Most of your parents have gone out 
drinking or have gone somewhere they weren't supposed to 
go.y But now when you do it, they ground you.g You 
probably figure, that they are just trying to be mean or show 
you who's boss.g But most parentj (I can't say all) are not 
anything like that.^Q The reason they punish you, is 
because they love you" and don't want anything to happen to 
you.^^ They always (well, at least most of the time) have a 
good reason for not letting you do some of the things you 
do.]^2 What If when they were In High School one of their 
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friends went to a bar, got drunk, drove home, or at leaat 
tried to, and got In an accident, possibly even killing 
sofseons.^^ You have to understand your parents and 
communicate with them, talking things over and learning to 
understand tlie reasons for doing things they do.** Through my 
four years I tried to communicate. And I found that I 
became a lot closer to my parents and that there were less 
arguments .^g I hope you take this word of advice and let It 
help you through the yiears.^^ 



Table 6 

Domlr.ant, Minor, and Pseudo Chains In 
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nuni)er 












1 




pass on 
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parents 


listen 










parents 
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they 
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them 


listen 
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parents 
they 










8 


they 
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they 








it 


10 


Ct^rents 






anything 




11 


they 
they 




reason 


■ anythlfig 




12 


they 




reason 


things 




13 


they 
their 










in 


— 1 — "■■ ~~ — — ^ 

parents 

thiem 

they 


* cormunlcate 
talking 


reasons 


thln/^s 
thir^gs 




15 




c'j<Trnunlcate 








16 


parents 










17 
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Such tabulated lists are, of course » entirely asyntactlc and offer no 
Insight into the hierarchy of ideas or the transitions between them. They 
provide merely a skeleton of lexical items In a loose systems network. 
Despite these shortcomings! a close ex2mination of the tabulations 
suggests some patterns that identify or distinguish them. 

1. Good and poor essays alike have what Markeis (1981) has called a 
dominant term, a word or phrase more or less continually present either 
directly (by reiterations) or inf erentlally (by synonyms, collocations, 

superordinates, and pronoun references). This dominant chain provides a 

> 

reservoir of associations to which the writer returns frequently for 
elaboration and predication as the discourse proceeds. 

2. Poor essays occasionally have a dominant chain that simply 
overwhelms the essay with the reiteration of its topic and pronouns for 
the topic. ' The poor essay above on listening to parents illustrates this 
pattern. The term parents and its pronouns appear 18 times In 17 t-units 
and there are only 15 terms in the other 3 chains combined. Good essays, 
on the other hand, have a dominant chain that constitutes a smaller 
proportion of the total items. As an example, the good essay on 
mathematics has 1,8 items in its dominant chain, but the three minor chains 
contain a total of 27 items. 

3. Good essays have greater variety (i.e., more different words) and 
maturity (i.e., words of lower frequency in the language as a whole and 
greater explicitness) in their chains. This feature can be observed in 
the dominant chain of the good ess^y (Table 5) which has mathematics, 
math> numbers and system along with pronouns. By conparison the poor 
essay (Table 6) has only parents and pronouns in its domlnat chain. 
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4. Poor writers have pseudo chalnB, non-cohesive strands of words 
such as things do, way, be , know , and have. These words collocate with 
virtually every word In the language and therefore bear little semantic 
import or explicitness. The pseudo chain in Table 6 illustrates clearly. 

5. Good essays have more real chains, and poor essays have fewer 
meaningful minor chains, the weakest of which comprise only 3 or A items. 
Minor Chain 2 in Table 6 is an example of this feature. 

6. Chains .can be related to paragraphs in several ways: chains may 
tie together several paragraphs (and in fact the whole essay) or may be 
almost completely confined in a single paragraph (Minor Chain 2 in Table 
5). In other cases, chain items may be heavily concentrated in one 
paragraph and then reoccur more sparingly in others. 

Discussion . 

It may be argued that these observations are not in any sense new. 
They a^re the kinds of remarks that teachers make about student writing, 
only now they are couched in the language of cohesion. For example, 
Shaughnessy (1977), in her classic study of errors among basic college 
writers, has a chapter on vocabulary that notices many of the same 
findings observed in the lexical chains tabulated for this research: 
inadequate synonymies; extensive reiteration without variety; repetition 
of high-frequency, low-significance words; inappropriate word choice. Is 
cohesion, therefore, just a new jargon or has anything useful been 
learned? Halliday and Hasan (1976, 327-328) clearly distinguish between 
what a text means and how it attains that meaning. The study of cohesion 
in a text does not add to what the texL means, but can help In 
understanding how and ifhy it attains that meaning. In addition, notions 
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Buch as chain, tie , coherer , precursor , context , and texture all suggest 

valuable truths about discourse: that connectedness Is at the core of 

meaning; that no discourse Is without relationship to Its environment no . 

matter how remote; that meaning Is resolved not In a single word or phrase 

but through longer semantic structures. Readers often speak of following 

a text, of writers' leading readers to a conclusion, of stories flowing to 

their endings, of articles running too long. Thus the terminology of 

cohesion is in keeping with common descriptions of the meaning-making 

process. Teachers must speak to students about writing, and they must 

therefore share some lexicon of terms for their talk. The traditional 

terminologies of the parts of speech or structural parts of sentences all 

shared the weakness of implying that texts are made from static, unitary, 

and unmoving segments like bricks or stones. The terminology of 

transformational and generative grammar suggested notions of depth and 

surface, with sentences having a history, the story of transformations as 

sentences come upward from deep to surface structure (Myers, 1^81, 10). 

The terminology of cohesion, on the other hand, suggests an Idea of 

interrelatedness in networks or sytems and a notion of flow or movement. 

No one terminology should supplant all the others. As Young, Becker, and 

Pike argued in their famous (1971) text. Rhetoric: Discovery and Change ,. 

entities should be observed and interpreted as particle, wave, and field 

in order to be fully understood. Cohesion has given teachers a 

terminology to discuss the field aspects of text-making. 

Implications for Evaluation and Teaching 

The major limitation of the cohesion system is that It describes only 

one-third of a complete theory of language, namely the textual function or 
» 
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text-f orming component of the linguistic system. The other two functions 
of language In Halllday and Hasan's (1976, 26-27) system are the 
ideational and Interpersonal. The Ideational Is concerned with content, 
with the function that language has of being about something. The 
interpersonal is concerned with social, expressive, and conatlve 
functions; with expressing attitudes , judgments, role relationships and 
motives for speaking or writing. The cohesion system does not and cannot 
capture or describe these ideational or interpersonal qualities of 
language. Consequently, cohesion should not be the exclusive or central 
emphasis of either a pedagogy or an evaluation method for writing. 

In the language of test-makers and evaluators, the cohesion system 
lacks content validity or domain selection validity (Popham, 1975, 120, 
156-159). In other words, measuring cohesion is not measuring enough of 
all the things that should be measured if one wishes to accurately 
evaluate a language act. Classroom teachers even more than researchers 
will feel constrained if they attempt to rely heavily on estimates or 
counts of cohesive ties in evaluating student writing, because such an 
emphasis may detract attention from the quality of ideas, the sense of 
audience, the development of purpose, and the creation of persona, all of 
which should be more central to evaluation. Cohesion is also on the 
borderline of usability, another important quality of evaluatlon*^systeras . 
The full list of all types of ties in Halllday and Hasan's system 
represents 176 categories and subcategories. Only 18 plus the distance 
values were reported in this research, but that represents more categories 
than roost teachers would wish to deal with for purposes of routine 
classroom evaluation. 
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Ann Ruggles Gere (1980) argues persuasively that an evaluation method 
based on all three of Halllday and Hasan's language functions would be 
superior to such current methods as analytic scales, primary trait 
scoring, general Impression scales, and holistic scoring. Such a method 
would represent the first theoretically sound evaluation system. But the 
attempt to use cohesion as the primary emphasis for evaluation would be 
doomed to failure. Cohesion, except for certain characteristics of 
cohesive chains and distances, is simply not sufficiently related to 
writing quality. In addition, the research reported here finds some 
aspects of cohesion sensitive to length of essay, and this could introduce 
confusion into the evaluation of writings that vary greatly in length. 

Regarding pedagogy, only one controlled and systematic attempt to 
teach cohesion as the emphasis in instruction and then evaluate essays by 
counting types of ties has been published. Hartnett (1980) had mixed 
results, with no significant differences being found for teacher, 
treatment, or mode of writing for the ^xperiraentals over the controls and 
a relatively low correlation (.2076) between the number of different 
cohesive titfs (Hartnett's basic variable) and holistic score. 

The research reported here suggests that a better use of the cohesion 
system would be in a teacher's responding to a full piece of writing and 
in suggesting revisions. For example, pointing out reiterations in a text 
could help a student understand excesses or insuf f Iclences of redundancy. 
By circling items in a cohesive chain, a teacher could help explain his or 
her perceptions of the too rapid or too slow pace and development of the 
student •s ideas. Pointing out the distances between precursor and coherer 
items could help the student appreciate the teacher*s difficulty in 
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followlng the thread of meaning If too much space Intervenes between terms 

In a cohesive relation. As Holloway (1981) has suggested^ this kind of 

Instruction could become not Just a new jargon but an invitation for 

students themselves to ask new and higher-order questions af^out their 

writing. Including; "What Is the old Information I need to present so 

that I can tie this idea to what has gone before?" and "Have I reflected 

the connections of thought in my thesis statement implicitly or explicitly 

in the devices I have used for cohesion in the body of ray paper?" 

t 

Questions such as these combine the insights of the cohesion scheme with 
the concerns for Ideational and interpersonal functions necessary to make 
the text coherent as well as cohesive. Coherence implies that the 
ideational and interpersonal functions of language must be respected as 
first principles. 

In conclusion, this research clearly suggests that the cfahesion scheme 
not be over-prompted as a testing or evaluation method or as a central 
emphasis In the teaching of writing. Counting up cohesive ties In general 
did not distinguish the good from the poor writing' examined in this 
study. And cohesion is surely too narrow an aspect of language to have as 
the center of teaching writing. 
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